Electronic device for scene evaluation and image projection onto non-planar screens

ABSTRACT

An electronic device may have one or more imaging sensors. The imaging sensors may be used in combination with an optional mechanical gesture to analyze the lighting conditions of the environment around the electronic device. The electronic device may set auto-exposure, auto-white balance, and auto-focus settings based on the analysis. The electronic device may include a shaped display. The imaging sensors may be used in calibration of a projector for the shaped display and may be used in sending touch inputs associated with the shaped display. The electronic device may be able to capture a photograph during video capture. The electronic device may generate a display screen that identifies which portions of the scene being imaged correspond to the video and which portions correspond to the photograph.

This application claims the benefit of provisional patent applicationNo. 61/642,149, filed May 3, 2012, which is hereby incorporated byreference herein in its entirety.

BACKGROUND

The present invention relates to imaging systems and, more particularly,to imaging systems that may use scene evaluation in improving imagequality, imaging systems that may be used in supporting shaped displays,and imaging systems that simultaneously capture images having multipleaspect ratios.

Electronic devices such as cellular telephones are often provided withcamera sensors. When capturing an image (and when capturing video), thecamera sensors may, as examples, perform auto-white balance,auto-exposure, and auto-focus processes. The trio of auto-white balance,auto-exposure, and auto-focus processes may sometimes be referred to asa 3A convergence process. Typically, the 3A convergence process involvescapturing a low-resolution preview image and then analyzing that imageto determine appropriate imager settings for white balance, exposure,and focus. Once appropriate imager settings are determined, a camerasensor can capture a full-resolution image using the automaticallyselected settings. The dependence of traditional camera sensors on asingle preview image limits image quality, as the image settings derivedfrom that single preview image are often not optimal.

Traditional displays and touch surfaces are rigid (i.e., non-flexible),planar, and rectangular in shape. Display and touch surface designersare therefore unable to provide displays that are flexible, non-planar,and/or non-rectangular (e.g., randomly-shaped displays).

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagram of an electronic device and computing equipment thatmay be used in producing images with decreased depth of field inaccordance with embodiments of the present invention.

FIG. 2 is a diagram of an illustrative array of light-sensitive imagingpixels and control circuitry coupled to the array of pixels that mayform a camera sensor such as the camera sensor of FIG. 1 in accordancewith embodiments of the present invention.

FIG. 3 is a perspective view of an illustrative electronic device thatmay have one or more image sensors and that may analyze and may monitorits surrounding environment using the image sensors in accordance withembodiments of the present invention.

FIG. 4 is a flowchart of illustrative steps involved in using camerasensor(s) such as the camera sensor(s) of FIG. 3 and an optional devicemovement in analyzing the surrounding environment and capturing at leastone image in accordance with embodiments of the present invention.

FIG. 5 is a diagram of an illustrative shaped display that may be touchsensitive and optical components such as camera sensors that may be usedin supporting the shaped display and optional touch sensing capabilitiesin accordance with embodiments of the present invention.

FIG. 6 is a flowchart of illustrative steps involved in calibrating aproject displaying images onto a shaped display and identifying touchinputs on the shaped display in accordance with embodiments of thepresent invention.

FIG. 7 is a diagram of an illustrative screen that may be displayed onan electronic device as part of simultaneously capturing multiple imageshaving different aspect ratios in accordance with embodiments of thepresent invention.

FIG. 8 is a block diagram of an imager employing one or more of theembodiments of FIGS. 1-7 in accordance with embodiments of the presentinvention.

FIG. 9 is a block diagram of a processor system employing the imager ofFIG. 8 in accordance with embodiments of the present invention.

DETAILED DESCRIPTION

Digital camera modules are widely used in electronic devices. Anelectronic device with a digital camera module is shown in FIG. 1.Electronic device 10 may be a digital camera, a laptop computer, adisplay, a computer, a cellular telephone, or other electronic device.Device 10 may include one or more imaging systems such as imagingsystems 12A and 12B (e.g., camera modules 12A and 12B) each of which mayinclude one or more image sensors 14 and corresponding lenses. Duringoperation, a lens focuses light onto an image sensor 14. The lens mayhave fixed aperture. The pixels in image sensor 14 includephotosensitive elements that convert the light into digital data. Imagesensors may have any number of pixels (e.g., hundreds or thousands ormore). A typical image sensor may, for example, have millions of pixels(e.g., megapixels). In high-end equipment, sensors with 10 megapixels ormore are not uncommon. In at least some arrangements, device 10 mayinclude two (or more) image sensors 14, which may capture images fromdifferent perspectives. When device 10 includes two image sensors 14,device 14 may be able to capture stereo images.

Still and video image data from camera sensor 14 may be provided toimage processing and data formatting circuitry 16 via path 26. Imageprocessing and data formatting circuitry 16 may be used to perform imageprocessing functions such as adjusting white balance and exposure andimplementing video image stabilization, image cropping, image scaling,etc. Image processing and data formatting circuitry 16 may also be usedto compress raw camera image files if desired (e.g., to JointPhotographic Experts Group or JPEG format).

In a typical arrangement, which is sometimes referred to as a system onchip or SOC arrangement, camera sensor 14 and image processing and dataformatting circuitry 16 are implemented on a common integrated circuit15. The use of a single integrated circuit to implement camera sensor 14and image processing and data formatting circuitry 16 can help tominimize costs. If desired, however, multiple integrated circuits may beused to implement circuitry 15. In arrangements in which device 10includes multiple camera sensors 14, each camera sensor 14 andassociated image processing and data formatting circuitry 16 can beformed on a separate SOC integrated circuit (e.g., there may be multiplecamera system on chip modules such as modules 12A and 12B). Circuitry 15conveys data to host subsystem 20 over path 18. Circuitry 15 may provideacquired image data such as captured video and still digital images tohost subsystem 20.

Electronic device 10 typically provides a user with numerous high levelfunctions. In a computer or advanced cellular telephone, for example, auser may be provided with the ability to run user applications. Toimplement these functions, electronic device 10 may have input-outputdevices 22 such as projectors, keypads, input-output ports, and displaysand storage and processing circuitry 24. Storage and processingcircuitry 24 may include volatile and nonvolatile memory (e.g.,random-access memory, flash memory, hard drives, solid state drives,etc.). Storage and processing circuitry 24 may also include processorssuch as microprocessors, microcontrollers, digital signal processors,application specific integrated circuits, etc.

Device 10 may include position sensing circuitry 23. Position sensingcircuitry 23 may include, as examples, global positioning system (GPS)circuitry, radio-frequency-based positioning circuitry (e.g.,cellular-telephone positioning circuitry), gyroscopes, accelerometers,compasses, magnetometers, etc.

An example of an arrangement for sensor array 14 is shown in FIG. 2. Asshown in FIG. 2, device 10 may include an array 14 of pixels 28 coupledto image readout circuitry 30 and address generator circuitry 32. As anexample, each of the pixels in a row of array 14 may be coupled toaddress generator circuitry 32 by one or more conductive lines 34. Array14 may have any number of rows and columns. In general, the size ofarray 14 and the number of rows and columns in array 14 will depend onthe particular implementation. While rows and columns are generallydescribed herein as being horizontal and vertical rows and columns mayrefer to any grid-like structure (e.g., features described herein asrows may be arranged vertically and features described herein as columnsmay be arranged horizontally).

Address generator circuitry 32 may generate signals on paths 34 asdesired. For example, address generator circuitry 32 may generate resetsignals on reset lines in paths 34, transfer signals on transfer linesin paths 34, and row select (e.g., row readout) signals on row selectlines in paths 34 to control the operation of array 14. If desired,address generator circuitry 32 and array 14 may be integrated togetherin a single integrated circuit (as an example).

Signals 34, generated by address generator circuitry 32 as an example,may include signals that dynamically adjust the resolution of array 14.For example, signals 34 may include binning signals that cause pixels 28in a first region of array 14 to be binned together (e.g., with a2-pixel binning scheme, with a 3-pixel binning scheme, or with a pixelbinning scheme of 4 or more pixels) and that cause pixels 28 in a secondregion of array 14 to either not be binned together or to be binnedtogether to a lesser extent than the first region. In addition, signals34 may cause pixels 28 in any number of additional (e.g., third, fourth,fifth, etc.) regions of array 14 to be binned together to any number ofdifferent, or identical, degrees (e.g., 2-pixel binning schemes,3-or-more-pixel binning schemes, etc.).

Image readout circuitry 30 may include circuitry 42 and image processingand data formatting circuitry 16. Circuitry 42 may include sample andhold circuitry, analog-to-digital converter circuitry, and line buffercircuitry (as examples). As one example, circuitry 42 may be used tomeasure signals in pixels 28 and may be used to buffer the signals whileanalog-to-digital converters in circuitry 42 convert the signals todigital signals. In a typical arrangement, circuitry 42 reads signalsfrom rows of pixels 28 one row at a time over lines 40. With anothersuitable arrangement, circuitry 42 reads signals from groups of pixels28 (e.g., groups formed from pixels located in multiple rows and columnsof array 14) one group at a time over lines 40. The digital signals readout by circuitry 42 may be representative of charges accumulated bypixels 28 in response to incident light. The digital signals produced bythe analog-to-digital converters of circuitry 42 may be conveyed toimage processing and data formatting circuitry 16 and then to hostsubsystem 20 (FIG. 1) over path 18.

As shown in FIG. 3, electronic device 10 may include one or more camerasensors such as camera sensors 14A, 14B, 14C, 14D, 14E, and 14F. Asexamples, camera sensor 14A may be a primary camera sensor located on afirst side (e.g., a front side) of device 10 and camera sensors 14B,14C, 14D, 14E, and 14F may be secondary camera sensors located onsecond, third, fourth, fifth, and sixth sides, respectively (e.g., rear,top, left, right, and bottom sides, respectively).

At least in arrangements in which electronic device 10 includes multiplecamera sensors 14 located on at least two different sides of device 10,the camera sensors may be used in analyzing and monitoring theenvironment surrounding device 10. Consider, as an example, anarrangement in which device 10 includes front facing camera sensor 14Aand rear facing camera sensor 14B. In such an arrangement, device 10 canuse camera sensors 14A and 14B (and/or any other camera sensors presentin device 10) in studying the scene about to be imaged (or being imaged)by camera sensor 14A and in studying the environment around device 10.Sensors 14A and 14B may be used to determine the location of lightsources in the environment around device 10, to identify characteristicsof those light sources (e.g., the color temperature of the lightsources, the color profile of the light sources, whether and how thelight sources are moving within the environment around device 10, thebrightness of the light sources, etc.). With this information, device 10can automatically optimize imager settings such as exposure, whitebalance, and focus for the image sensors of device 10 (e.g., for aprimary sensor such as sensor 14A), to maximize the quality of imagescaptured by device 10.

With some suitable arrangements, device 10 may utilize a mechanicalmovement or gesture when obtaining information about its surroundingenvironment with one or more camera sensors. As an example, in anarrangement in which device 10 includes a single camera sensor 12A,device 10 may, prior to capturing images, prompt a user of device 10 torotate device 10 (e.g., in a full 360 degree rotation, or in anothersuitable motion). In this example, the prompt presented by device 10 mayinstruct the user to hold device 10 out at arm's length and spin aroundin a full circle. While device 10 is moving (e.g., rotating), device 10can use camera sensor 12A (and any additional sensors present) todetermine the lighting characteristics of its surrounding environment.If desired, sensor 12A and any additional sensors present may operate ina high speed image capture mode when device 10 is utilize a mechanicalgesture to analyze its surrounding environment. As another example, inan arrangement in which device 10 includes a front camera sensor 12A anda rear camera sensor 12B, a 180 degree rotation may be sufficient. Ingeneral (e.g., in single or multi-camera systems), it may be desirablefor the motion of device 10 to include sufficient motion for device 10to analyze its surrounding environment (e.g., a full spherical analysisof the environment around device 10, a partial spherical analysis of theenvironment around device 10, a partial spherical analysis of theenvironment around device 10 including a half-sphere of the region abovedevice 10, etc.).

If desired, information on the environment surrounding device 10 may becached (i.e., stored) for later use. As an example, when device 10determines the lighting characteristics of its surrounding environment,those lighting characteristics may be used to determine appropriate 3Asettings for images captured shortly thereafter. In addition, data onthe lighting characteristics for a particular location (which may be alocation frequented by device 10) may be stored and, whenever device 10returns to that particular location (as determined by position sensingcircuitry 24 or by user input) the stored data may be used to determineappropriate 3A settings.

In at least some arrangements, device 10 may combine information fromthe sensors of FIG. 3 with information from additional sensors such asposition sensing circuitry 17. As an example, device 10 may use sensors14A and 14B to determine the location of the sun in an outdoorenvironment. Device 10 may then use sensors such as an accelerometer todetermine that device 10 is moving within the outdoor environment.Device 10 may then be able to track the changing position of the sunrelative to device 10 without having to continually determine theposition of the sun from the camera sensors 14 of device 10. In sucharrangements, device 10 may periodically reestablish the position of thesun using the camera sensors 14 of device 10, to ensure that any drifterrors from the accelerometer do not accumulate over time. Sucharrangements may allow device 10 to automatically and continually adjustits 3A settings (auto-white balance, auto-focus, and auto-exposure).

In general, device 10 may use any available sensors and inputs such asglobal positioning system (GPS) circuitry, accelerometers, compasses,magnetometers, clocks, etc. to determine the location of device 10 andlighting conditions around device 10. As examples, GPS circuitry may beused to determine if device 10 is traveling in a vehicle, accelerometercircuitry may be used to determine if device 10 is rotating (e.g., is ona carousel or is otherwise being rotated), and the location of the sunrelative to device 10 based on the current time, date, compass settings,and location.

A flowchart of illustrative steps involved in using one or more camerasensors 14 and/or sensors such as circuitry 23 in analyzing theenvironment around device 10 (e.g., the lighting conditions) andcapturing an image are shown in FIG. 4.

In step 44, device 10 may use image sensors such as sensors 14A, 14B,14C, 14D, 14E, and 14F and/or sensors such as GPS circuitry,accelerometers, clocks, compasses, magnetometers, etc. to identifylighting characteristics of the environment around device 10 (which isabout to be imaged by device 10). If desired, step 44 may involvemovement of device 10 by a user (e.g., a 360 degree, 180 degree, orother mechanical movement of device 10). For example, device 10 may useinformation from these sensors to determine the locations of lightsources in the environment, the brightness of light sources in theenvironment, the color temperature of light sources in the environment,whether any of the light sources are moving relative to device 10,whether the brightness and/or color temperature of any of the lightsources are changing, etc.

In step 46, device 10 may use information gather in step 46 to identifysuitable 3A settings for one or more camera sensors and may capture andprocess one or more images using the camera sensors using those 3Asettings. The 3A setting may include one or more of an auto-exposuresetting, an auto-white balance setting, and an auto-focus setting. As anexample, in an arrangement in which device 10 determined in step 44 thatthe scene to be imaged in step 46 is an outdoor scene at sunset with thesun behind device 10, device 10 may set its 3A settings to optimizepicture quality for any images captured in step 46.

If desired, electronic device 10 may include a shaped display such asdisplay 60 having a shaped screen 62 of FIG. 5 (e.g., an input-outputdevice 22) and device 10 may include camera sensors such as camerasensors 14G and 14H for calibration of shaped display 60 and/or forsensing touch inputs on shaped display screen 62. Camera sensors 14G and14H may be any suitable type of camera sensors. As an example, camerasensors 14G and 14H may be high dynamic range imaging sensors, to ensuresufficient image quality in varied lighting conditions (as may bepresent in an automobile, as an example). If desired, sensors 14G and14H may be sensitive to infrared light, visible light, or infrared lightand visible light, as examples. As shown in FIG. 5, shaped display 60may be a display having a shaped screen 62 with any desired shape,including non-rectangular and/or non-planar formats. Shaped displayscreen 62 may, if desired, be a flexible display screen, which mayfacilitate formation of shaped display screen 62 into a desired shape.As one example, shaped display screen 62 may be in a dashboard in anautomobile and have a non-planar and/or non-rectangular shape.

Device 10 may include projector 48; touch display processor 50 includingwarping engine 52, dewarping engine 54, and image signal processing(ISP) and image computational (ICE) engine 56, and processing circuitry58.

With at least some arrangements, the projection of images onto theshaped screen 62 may be accomplished using warping engine 54 (inaddition or alternatively, projector 48 may include lens structures thatat least partially warp the projected image). In particular, projector48, if driven with non-warped display signals, may require asubstantially planar and/or rectangular display screen for properoperation (e.g., for the display to be in focus and to scale across theentire display screen). Therefore, in arrangements of the presentinvention in which display screen 62 is non-planar and/ornon-rectangular, projector 48 may be driven with warped display signalsthat ensure that images projected onto screen 62 are in focus and toscale across the entirety of the active portion of screen 62. In otherwords, since display screen 62 is “warped” from a traditionalrectangular and planar display screen, the output of projector 62 mayalso be warped (using warping engine 52) to compensate for the “warping”(from the rectangular and planar norms) of display screen 62.

Camera sensors 14G and 14H may be used in calibrating warping anddewarping engines 52 and 54. Calibration operations may be performed atany desired time. As an example, calibration operations may be performedupon power up of device 10. In arrangements in which curved display 60may be powered up after (e.g., separate from) powering up device 10,calibration operations may be performed upon power up of curved display60. Calibration operations may include projecting a known pattern (suchas predetermined grid lines) with projector 48, imaging the projectedpattern using camera sensors 14G and 14H, and analyzing the images fromsensors 14G and 14H to determine appropriate warping and dewarpingsettings for engines 52 and 54. If desired, calibration operations mayinvolve an iterative process that repeats until the projected patternfits onto curved display screen 62 correctly (e.g., is in focus and toscale across the entirety of the display screen).

Alternatively or in addition to calibration operations, camera sensors14G and 14H may be used in sensing touch inputs on shaped display screen62. In particular, during normal operation sensors 14G and 14H,dewarping engine 54 and circuitry 56 may identify user touch inputs onthe surface of display screen 62, including the location of the inputswithin the display screen 62. When touch inputs are detected, circuitrysuch as circuitry 56 and 58 may provide appropriate command informationto host subsystem 20. If desired, camera sensors 14G and 14H may beconfigured to capture stereo images. In such arrangements, camerasensors 14G and 14H, dewarping engine 54, and circuitry 56 may identifyuser input in a projected space 64 in front of the display screen 62. Ingeneral, curved display 60 can perform calibration operations and/oridentify touch inputs even in arrangements in which display 60 includesonly a single camera sensor such as sensor 14G.

A flowchart of illustrative steps involved in calibrating a shapeddisplay such as shaped display 60 and identifying touch inputs on theshaped display are shown in FIG. 6.

In step 64, a known pattern may be projected onto the shaped display. Asan example, projector 48 nay project a predetermined pattern such as anarray of parallel lines (e.g., grid lines) onto shaped display screen62.

In step 66, one or more image sensors may capture one or more images ofthe projected pattern. For example, camera sensors 14G and 14H maycapture one or more images of the pattern projected onto screen 62 instep 64.

In step 68, differences between the projected pattern (as imaged in step66) and the expected pattern (e.g., the desired appearance of thepattern when projected onto screen 62) may be determined and appropriatewarping and dewarping settings generated. The generated warping anddewarping settings may be used to configure engines 54 and 56.

As illustrated by dashed lines 74, the processes of steps 64, 66, and 68may be repeated. As an example, the processes of steps 64, 66, and 68may be repeated as part of an iterative process that repeats until thedifferences between the projected pattern (as imaged in step 66) and theexpected pattern are less than a predetermined threshold. Alternativelyor in addition, the processes of steps 64, 66, and 68 may be repeatedperiodically. Such an arrangement may be beneficial in embodiments inwhich display screen 62 is flexible and/or subject to warping over time.

In step 70, images (e.g., data) may be projected onto display screen 62by projector 48. The projected data may be appropriately warped bywarping engine 52 such that the projected images are in-focus, to-scale,and fill the active region of display screen 62.

In step 72, one or more camera sensors such as camera sensors 14G and14H may be used to identify touch inputs on the surface of displayscreen 62 (or in region 64 in front of display screen 62). As anexample, camera sensors 14G and 14H, together with dewarping engine 54and circuitry 56 and 58 may be used to identify shadows on the surfaceof display screen 62 indicative of a user's finger pressing against aportion of display screen 62.

In accordance with various embodiment of the present invention, device10 may include a camera sensor 14 capable of simultaneously capturingimages having different aspect ratios and may include a display thatfacilitates the simultaneous capture of images having different aspectratios. As an example, camera 14 may be used in capturing video in afirst format (e.g., a widescreen 16:9 format or any other suitableformat) and, without interrupting video capture operations, camera 14may take a photograph in a second format (e.g., a snapshot in a 4:3format or any other suitable format. With some suitable arrangements,the simultaneous capturing of images having different aspect ratios maybe accomplished with a high speed camera sensor 14 capable of capturingthe photograph in-between adjacent frames of the video. In order toassist a user of device 10 in simultaneously capturing images havingdifferent aspect ratios, device 10 may include a display (e.g., aninput-output device 22, a shaped display 60, etc.) that displays screen75. Display screen 75 may display real-time previews of images beingcaptured or images that could be captured by one or more image sensorsin device 10. Display screen 75 may include a central region 76 in thefirst format (e.g., the widescreen 16:9 format) and additional regions78 that, in combination with the central region 76, are in the secondformat (e.g., the 4:3 snapshot format). If desired, the additionalregions 78 may be presented in such a way as to identify to the userthat the regions 78 are not part of the video format but are part of thephotograph format. As examples, the additional regions 78 may be dimmedrelative to the central region 76 and/or the additional regions 78 maybe alpha blended to provide a semi-transparent appearance to regions 78.Both regions 76 and 78 may be filled with image data of a scene beingimaged by camera sensor 14 of device 10.

If desired, display screen 75 may include a side frame 80 include one ormore user-selectable icons such as icons 82A, 82B, and 82C. As examples,icon 82A may be an icon allowing a user to start and stop (or pause) avideo record, icon 82B may be an icon allowing a user to take a single(or multiple) photograph, and icon 82C may be an icon that enables anddisables the dimming and/or alpha blending of the additional regions 78.

FIG. 8 illustrates a simplified block diagram of imager 200 (e.g., animager that may analyze its surrounding environment to determined 3Asettings, that may support a shaped display, and that may simultaneouslycapture video and photographs having different aspect ratios). Pixelarray 201 includes a plurality of pixels containing respectivephotosensors arranged in a predetermined number of columns and rows. Therow lines are selectively activated by row driver 202 in response to rowaddress decoder 203 and the column select lines are selectivelyactivated by column driver 204 in response to column address decoder205. Thus, a row and column address is provided for each pixel.

CMOS imager 200 is operated by a timing and control circuit 206, whichcontrols decoders 203, 205 for selecting the appropriate row and columnlines for pixel readout, and row and column driver circuitry 202, 204,which apply driving voltages to the drive transistors of the selectedrow and column lines. The pixel signals, which typically include a pixelreset signal Vrst and a pixel image signal Vsig for each pixel aresampled by sample and hold circuitry 207 associated with the columndriver 204. A differential signal Vrst-Vsig is produced for each pixel,which is amplified by amplifier 208 and digitized by analog-to-digitalconverter 209. The analog to digital converter 209 converts the analogpixel signals to digital signals, which are fed to image processor 210which forms a digital image.

FIG. 9 shows in simplified form a typical processor system 300, such asa digital camera, which includes an imaging device such as imagingdevice 200 (e.g., an imager that may analyze its surrounding environmentto determined 3A settings, that may support a shaped display, and thatmay simultaneously capture video and photographs having different aspectratios). Processor system 300 is exemplary of a system having digitalcircuits that could include imaging device 200. Without being limiting,such a system could include a computer system, still or video camerasystem, scanner, machine vision, vehicle navigation, video phone,surveillance system, auto focus system, star tracker system, motiondetection system, image stabilization system, and other systemsemploying an imaging device.

Processor system 300, which may be a digital still or video camerasystem, may include a lens such as lens 396 for focusing an image onto apixel array such as pixel array 201 when shutter release button 397 ispressed. Processor system 300 may include a central processing unit suchas central processing unit (CPU) 395. CPU 395 may be a microprocessorthat controls camera functions and one or more image flow functions andcommunicates with one or more input/output (I/O) devices 391 over a bussuch as bus 393. Imaging device 200 may also communicate with CPU 395over bus 393. System 300 may include random access memory (RAM) 392 andremovable memory 394. Removable memory 394 may include flash memory thatcommunicates with CPU 395 over bus 393. Imaging device 200 may becombined with CPU 395, with or without memory storage, on a singleintegrated circuit or on a different chip. Although bus 393 isillustrated as a single bus, it may be one or more buses or bridges orother communication paths used to interconnect the system components.

Various embodiments have been described illustrating imaging systemsthat may use scene evaluation in improving image quality, imagingsystems that may be used in supporting shaped displays, and imagingsystems that simultaneously capture video and photographs havingdifferent ratios.

An imaging system may be used to identify lighting characteristics ofits surrounding environment. As an example, an imaging system may useone or more camera sensors together with an optional mechanical gestureto identify the locations and color temperature of light sources andother lighting characteristics of the surrounding environment. Afterdetermining the lighting characteristics of the surrounding environment,the imaging system may use the determined lighting characteristics isgenerating imager settings such as auto-exposure, auto-white balance,and auto-focus settings. The determined lighting characteristics may bestored for later use, which may be especially beneficial if the imagingsystem frequently captures images in on or more favorite locations.

An imaging system may be used in supporting a shaped display. Theimaging system may be used in calibrating warping and dewarping enginesfor the shaped display, such that images projected into a shaped displayscreen are properly displayed. In addition or alternatively, the imagingsystem may be used in identifying user touch input on the shaped displayscreen and/or user spatial input in front of the shaped display screen.

An imaging system may be capable of capturing video in a first formatand, while capturing the video, capturing a photograph in a secondformat. The imaging system may be incorporated into an electronic devicehaving a display. The display may be configured to display a screenincluding a preview of the video in the first format and a preview ofthe photograph in the second format, where some portions of thephotograph have been altered to visually distinguish portions of thesecond format that do not overlap with portions of the first format.

The foregoing is merely illustrative of the principles of this inventionand various modifications can be made by those skilled in the artwithout departing from the scope and spirit of the invention. Theforegoing embodiments may be implemented individually or in anycombination.

What is claimed is:
 1. A method, comprising: with an electronic device,prompting a user to perform a mechanical gesture with the electronicdevice, wherein prompting the user to perform the mechanical gesturewith the electronic device comprises prompting the user to move theelectronic device along a curved path while holding the electronicdevice at arm's length; with at least one camera sensor in theelectronic device and during the particular mechanical gesture,capturing image data of an environment around the electronic device;with image processing circuitry in the electronic device, identifyinglighting characteristics of the environment based on the image data;with circuitry in the electronic device, determining imaging settingsbased on the identified lighting characteristics; and with the at leastone camera sensor, capturing an image using the determined imagingsettings.
 2. The method defined in claim 1 wherein the lightingcharacteristics comprises at least one lighting characteristic selectedfrom the group consisting of: a location of a light source, a colortemperature of the light source, a color profile of the light source, anintensity of the light source, and a relative velocity of the lightsource.
 3. The method defined in claim 1 wherein the determined imagingsettings comprise at least one imaging setting selected from the groupconsisting of: an auto-white balance setting, an auto-exposure setting,and an auto-focus setting.
 4. The method defined in claim 1 whereinprompting the user to perform the mechanical gesture comprises: with theelectronic device, prompting the user to rotate the electronic devicebetween 180 and 360 degrees.
 5. The method defined in claim 1comprising: with location sensing circuitry, determining a location ofthe electronic device; and storing the determined location together withat least one of the captured image data, identified lightingcharacteristics, and determined imaging settings in nonvolatile storagein the electronic device.
 6. The method defined in claim 5 wherein thelocation sensing circuitry comprises global positioning systemcircuitry.